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1- Introduction 

Nany problem solving tasks, such as computer programming, Bay be 
character i 2^(1 as the design of artifacts. This paper provides an overview of the 
authors 1 recent research an SPADE (Structured limning and Debugging), a theory 
oT tbts design process. Our purpose here is to provide a coherent overall 
framouork. Each topic introduced is covered in greater detail elsewhere 
[Goldstein St Miller 1976a, b; Niller * Goldstein 1976b,e,d], 

Figure 1 illustrates nur perspective on the construction of Information 
processing theories of cognition. Ve view this enterprise as involving 
normative, synthetic, and analytic aspects, We see It as representing a new 
paradigm based upon a marriage of methods and goals from several traditional 
disciplines, including artificial intelligence, psychology, pedagogy, and 
Compu ter s c i n n c , 

1.1. Objectives and Methodology: Onir own research project may he viewed 
as an instantiation of this general paradigm, with sub-projects addressing all 
three aspects {figure 2). As shown by the cental circle in the diagram, we seek 
to construct a computational theory ef the design process. We wish to test the 
utility and validity of this theory, SPAbE, In a variety of contents. This leads 
to spaclfic goals and methods, represented by the three outlying circles In the 
diagram, which span the synthetic, analytic, and normative aspects end 
Applications Ot the theory. 

1^ The synthetic (Al) goal is to explore computational theories of problem 
solving and 1 C a rn iflg . The nethod is to Construct program that embody 
these theories. This concern is reflected In our work on PATH 
[Goldstein * lillor t975bl, a problem solving progran which will plan and 
debug simple blocks world end graphics programs, the support for an Al 
theory is determined primarily by the competence and efficiency of tha 
associated computer prograifl in performing a prescribed set of tasks. 
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FIGURE 1 - INFORMATION PROCESSING THEORIES OF COGNITION 
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FIGURE 2 - A LINGUISTIC THEORY OF DESIGN AS PLANNING & DEBUGGING 
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2- The analytic (psychological) goal is to account for the knowledge states 

and learning strategies of individuals. Our method is. to analyse 
protocols of subjects interacting with precisely controlled computer 
environments as they solve some problem [Millar a Goldstein 19760), We 
seek, to nodal the subject's current know ].*> dsie r not onTy about the 
particular domain, but also about planning and debugging strategies , 
PAPAIN fnillEr * Goldstein ig76d], a system to analyze elementary 
programming protocols and reveal the use of various plans and debugging, 
techniques, incorporates this conccrn r A theory of design embedded in in 
automatic protocol analyzer is supported to the extent to which it can 
describe and predict the subject's responses: both tho final solution 
and observable details of the design process by which that solution ll 
found , 

J, Tho normative £ educational) gial is to prescribe design nethodology for 
both students (such as beginning programmers) and expert human problem 
solvers (such as professional programmers). This is partly a pedagogical 
concern j wb wish to experiment with the SPAflR theory as the basis If or a 
curriculum about problem solving. At the sane time, it shares the 
structured programming movement's concern to improve the quality and 
reliability of software. The former concern is explored through the 
design for SHERLOCK: [Goldstein & Hiller ig?6a] r an Hypothetical computer 
tutor which embodies our vision or flexible, sensitive uses of computers 
to teach problem solving and enhance education. The latter concern is 
explored via tne SPADE editor [Hiller *- Coldstain 1976c], a grammar -based 
environment, to assist beiinnitig programmers in acquiring, end 
professional programmers in adhering to, a toj>-do*n, structured design 
discipline. These systems, lite PATH and PAZATJJ, though potentially 
valuable as applications programs, are mainly intended as experimental 
tools for testing the BPADE theory. The exj?erimenta I. methodology is to 
systematically vary the operation of the learninu or programming 
environment. The claims of the theory are supported to tho extent to 
which the system as a whale (as well as its various components) aid£sJ 
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the user in solving harder problems mar* quickly . 

Combining these methods and goals into i single research pre or an has 

powerful synergistic effects ^ We have realized this in our particular projects 
through the development of a unifying linguistic theory of design. 

l.Z, A Linguistic Analogy ^ In developing a Formalism for representing 
problem solving techniques, we have been guided by a novel perspective* an 
analogy to computational linguistics. We have found this analogy to OB fruitful 

for several reasons, 

1+ Computational linguistics, though intandfid to- llluminata the nature of 
language ptr j*, his produced a set of concepts and algorithms for 
characterizing and explaining complex computational processes which are 
both perspicuous and rich in power. Problem solving, as a complex 
process, benefits from the application of these tools - 

Z- Computational linguistics decomposes computations into syntactic* 
semantic, and pragmatic components- This decomposition clarifies the 
explanation of complex processes, whin slewed in the fol lowing manner % 
syntax fornalUcs the range of possible decisions; semantics the problem 
description, and pragmatics the relationship between the two. 

3- Computational linguistics has undergone an evolution of procedural 

formalisms, beginning with finite Steta automata, later employing 
recursive transition networks Uontext free gr*nmars), next moving on to 
augmented transition networks, and culminating in the current set of 
theories involving frames, ate. Following this evolutionary sequence In 
language theories illuminates thair complexity. Bach phase captured some 
properties Of language^ but was incomplete and required; general izntlon to 
mere powerful and elaborate formalisms, tloraovar, the interrelationship* 
among many of those formalisms have been thoroughly delineated. 
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From this evolutionary (respective , one need not rteteSsarily vie** a gdvan 
Stage oT theorizing as Tvrong. Sometimes an earlier theory 13 wrong, but in Other 
•cases the flirlUr approach can ba valuable as an Abstraction in Its own right, 
which illuminates some dimension pf the phenomena, even though it is inadequate 
as a. complete theory, We are following a sequence parallel to that exhibited by 
computational linguistics in our own study of problem solving 

In this evolutionary development or SPADE, our theory of the design 
process, two sub-tasts have hafin Addressed, First, we have analyzed certain 
intricacies of planning and debugging, such as are encountered in the design or 
programs -which must take into account interactions in achieving dependent 
sub goals. The second sub'tasfc has bE*n to seek, a representational framework lit 
Which to elucidate thnse «:tihtleties, and In which to structure a wide variety oT 
planning techniques, Our approach has been to begin with simple but clear 
formalisms, studying their virtues jnd limitations. Our plan is to continue to 
investigate a series of progressively more powerful and elaborate 
representations, after reaching a solid understanding as to where the extra power 
is needed, And why. 

To date, we have explored context free planning grammars, and their 
Generalization t& ATM'j; we have transferred the insight gained Troto studying 
planning to the development of a model of debugging; we have examined the 
metaphor of protocol analysis as parsing, and studied the use of a chart parser 
as a means to discovering these analyses. 

■ 

Z. A Linguistic Theory of Plannin g; 

The ccntor circle of figure Z provides the setting for the discussion in 
this section and the next. Then, having introduced some hasic notions of the 
SPADE theory of design. He Will be in a position to Jliove 10 the peripheral 
aspects (the outer circles} in sections four, five end six, 
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JL1^_ A Taxonomy of Planning Concepts' The basis for SPADE is a taxonomy 
oT frequently observed planning concept* {rigure 3), V* arrived at this taxonomy 
partly by Introspection , partly by examining problem salving protocols [Fuller * 
Goldstein 19TG&], end pertly by studying the literature on problem solving 
[Fojya 1957, 1962, 1955, 1957, 19GQ; Mewell A Simon 1972; Sussman 197S* 
Sacerdoti 1975]. We regard the taJtOIIOny as neither COmfrlate nor unique. Part of 
the research prograa Is the classification of additional techniques, and the 
evaluation OT alternative organizational schemes. 

There are three mijor classes of pi ins In the taxonomy; identification, 
decomposition, and reformulation. Identification means recognizing a problem as 
previously solved, Decgnpo-si tion refers to strategies for dividing a problem 
into simpler sub-problems. Reformulation plans alter the problem description , 
seeking a representation wh i ell Is mora amenable to iden t ific at ion. or 
decomposition r The figure suggest] how these classes of plans are further 
subdivided in the SPADE theory. 

2.2, A Grammar pf Plans: Planning, according to the theory p is a process 
in which the problem solver selects the appropriate plan type, and then carries 

out the SUbgoals defined by that plan applied to the current prob-lem. FrOD this 
viewpoint, the plannlhtf taxonomy represents a decision tree of alternative plans. 
The decision process can be modeled by a context free grammar (figure 4), 

Consider the top level rule of this grammar; 

PI: SOLVE -> PLAN *■ [DEBUG]. 
The nonterminal symbol SOLVE is analogous to the nonterminal SENTENCE in ■ 
gromnar Tor language. In our notation „ PI means that planning is first used to 
generate a plan, with subsequent debugging Laen being required to complete the 
solution. Since the plan may be entirely correct, DEBUG is in brackets, 
indicating that it is an optional constituent. 

The disjunctive rule^ PZ r represents the choice -- in our taxonomy — 
between the three mutually exclusive categories of plans; Identification, 
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FIGURE 3 
TAXONOMY OF PLANNING CONCEPTS 



Figure 4, Qjn A flrannar^ of Plana 



PI: SOLVE 

PZ: PLAN 

P3: IDENTIFY 

P4: DEFINED 

P9; DEtOflPGEE 

PG; CONJUNCTION 

P7; LINEAR 

FA: SEQ 

H: 3€T 

Plfl: SETUP 

Pll: HAINSTEP 

P12: INTERFACE 

PUl CLEANUP 

P14: REPETITION 

PIS: ROUND 

P1&; ITER-PLAN 

P17; TAIL-RECUR 



■> PLAN + [DEBUG] 

-> IDENTIFY | DECOMPOSE I REFCRmiLATE 

O PM1IT1VE I DEFINED 

-> "us* coda* A "get file" 

-> COH JUNCTION | HEP ET FT ION 

-> LINEAR | NONLINEAR 

-> SET | £E4 

-> [SETUP] + UWINSTEP + [ rWTtKrACE J>" + [CLEANUP] 

-> <SOLVE>" 

-> SOLVE 

-> SOLVE 

-> SOLVE 

-> BOLVT; 

-> ROUND | RECURSION 

-> ITEfl-PLAN | tAlL-RLCUR 

->. "repeat step" + SEQ 

-> "stop step" + SEC + "recursion step* 



The rulas or the gramar are written uiing the following syntax: 
disjunction: "a | b" Is read ai, "a nr &■; 

ordered conjunction: "t + b" i& read as, "a tnd b' p where the order ie 

significant; 

ujtnrrfered eonjNJieHoff : "a ft b" Is read », "a and b" H where the order li 
insignificant; 

optionally: "[a]" is raad as, "a la optional"; 

iteration: "<a> • is read aa, ^a repeated 1 or nore tloas"; 

lexical catcn-ory: a lower ense English phrase enclosed- In quotation narki 
[e.g., "repeat step - } describes a lexical it so which ii nut further 
expanded 113 the granniar. 



Overview 1Z Hillar ft Goldstein 

decomposi t lo>n , and ref n rmu 1 at I on . 

PZ: PLAN -> IDENTIFY | DECOMPOSE I AEFaRhULATE 
The vertical bars indicate that a choice Is re-quired. Other rules are 
interpreted similarly. 

The SPADE theory It not restricted to any particular domain. However, to 
provide concrete example. 1 ; , most of our papers use problems from elementary Logo 
graphics programing [Papett igfla.tot 15?3]. Figure 5 illustrates the gramnar 
rules for prinitives in. this domain, Ftgiara S shows our favorite example -- a 
typical goal undertaken by beginners in Logo programming -- a "wi shingwel 1" 
picture r Figure 7 illustrates a solution to the wlshingwell problem with its 
hierarchical annotation according to our planning grammar. 

The ■gramnar of plans represents a useful abstraction of the decision 
process involved in selecting plans from the taxonomy. Ve illustrate this point 
in the next section, by analyzing debugging in terns nf the granoar. Later in the 
paper we show how the theory may be extended to include, not only the syntax, of 

plans, but their semantics and pragmatics as well. 

3, A Linguistic Theory of Debugging 

Often problem solvers must decide on a plan in the face of imperfect 
knowledge and limited resources. Even carerully reasoned judgments Bade Under 
*:hose circunstancas may turn nut to be mistaken: debugging is then required. 
Given a grammatical theory Of planning, debugging can be analyzed as the 
Localization and repair ot errors in applying granular rules during planning- The 
linguistic anaJogy unifies planning and debugging by tracing the origin of bugs 
to various types of erroneous planning choices. 
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Figure 3 Gras-jnar Rulea for La go Primitives 
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3-1, A Tmn^ of Hn 11: Sine* our planing r«l 8S were instructed fro« 

OPerit0 " F ° r ™J««»™- diction, lnd optloeaMty, three b ailc clftiSfla of 
errors arise; 

1. syntactic bug*, in which the basic ranunar is violated, such a* when * 
required cwjttact is missing; 

Z. 1-lHhtlc buQ5 , ln ft „„ nt|c Constr4lnt tpiMng fron thfl parttcular 

problem i 5 violated, such aJ wh* n a syntactically o^ei 0M i constituent 
needed beca„ S o f the seB!flntlcK , r the ^ riiatlar problem _ ^ ^^ , 

3, pregnane buff*. l n w hlch 4n inippro?rUU SftlflCtl&ft fr0B fl 5ft of 
mutually exclusive dij/iNtels is made. 

Thus* bug types ar9 illustrated In figure S, Although th„ 9 classes are 
edeanaf to characterize „„* ™ B||1 „ ^, ich „ tl , ln fllEnentary proflrfilwnlno 
additional Mtoprltt -U be defied t» niafc. this taxonomy or bugs collate. 

3 - Z ' Pla W" oals ™l frpiilr: An laportiiit aspect nf our research is the 
anei ysii er technics for diesis „* repair of pUnnitig 6ugs TheM 
technique can be clarified Wording co which ^presentation of a problem they 
'•^- ••■■ the probln specification (or mDde lJ, the solution (or code), the plan 
derivation or the process state. T^hBlqu.. far plan diagnosis can h* father 
citooortKtf according to the type ef planning 0Uff hypothesized; syntactic, 
mantle, er prattle, ( Ftirther fcullt of th „ dflbuflgljig theory ara ^.^ 
in later sections,) 

In the next three sect lens we ermine several eaperieienui applications 
programs which we have designed and intend to i m pW nt . T h* presentation i* 
or^aU^i according the aspects uf th, investigation represented by the outer 
circles of rigure Z, We must enphasize two points: first, that this division by 
aspects is * crude first approbation because of the considers* overlap 
implied by a unified approach; second, that while the program * hlc h ^ „. ¥t 
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FIGURE 8a - SYNTACTICALLY INCORRECT PLAN 
ft NECESSARY CONJUNCT IS MISSING 



TO WW 

10 TRIANGLE —USE 



MNJ) 



WW 

??? TRIANGLE UNDEFINED 7?? 



-ID-PLAN 



GET 



("GET" MISSING. UN GRAMMA T I CAL PLAN 
DEBUG BY COMPLETING PLAN.) 



C-ET TRIANGLE FILE- 



FIGURE ^b - SEMANTICALLY TNCORRECT PLAN 
AN OPTIONAL CONJUNCT IS HISSING 

FOR EXAMPLE i "WW" MISSING INITIAL SETUP, AND INTERFACE FOR POLE, 



TO WW 

10 WELL — WAINSTEF-r 

20 POLE — MAINSTEP- 



t> 



L SEQ-PLAN 



ends here 



u 



gtarts here 



FIGURE Sc - PRAfiMATTCALT,v INCORRECT FLAN 
AN INCORRECT DISJUNCT HAS BEEN SELECTED 



TO SQUARE -INS I DE-TRIANGLE 
10 SQUARE 
20 TfilAtfGLB 
END 

INTENDED PICTURE: 




LINEAR PLAN — 
SQUARE AND TRIANGLE 
DESIGNED 
INDEPENDENTLY. 

ACTUAL FICTURE; 
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designed potentially tiaua practical applicability, we regard then primarily as 
experimental tools, which will serve: to test the validity of the underlying SPADE 
theory. We turn First to the normative aspects, describing systems designed to 
encourage and teach articulate top-down structured design- 

4, Normative A s pects 

How can we Judge whether a particular griidmar gf plans captures, it soke 
level of abstraction, the sot of planning decisions which ought to be considered 
in solving prohlems for a domain? One methodology is tn incorporate the context 
free grammar into a program editing environment, to augment and direct the 
capabilities of a human user. The critical question then becomes deteminlng tit* 
extent to which such a support systen aids er hinders the user. This Is the 
rationale for SPADE, an editor that Incorporates our planning grammar r 

4,1 , SPAPE -- ft Grammar Base d Editor: SPADE [Killer ft Goldstein 19?Gc] 

is, an acronym for Structured Planning and Prba^inj Editor. He chose this name 
to emphasize the link between our research end the structured programming 
raovcment. Dahl, Dijfcstra, and Hoare [1972] call for a style of programing which 
reflects coherently structured problem solving. But a detailed formalization of 
■what this style entails is lacking. Our efforts In this direction, therefore, 
naturally supplement the t»iork af Df JKstra and others. 

Suppose a problem solver is defining ■ Logo program for drawing the 
wishlngwell shown earlier, In SPaDE, this is accomplished by applying the 

planning grammar in generative made. For example : 

la. What is the nane or your top level procedure? 
lb. >WW 

2a. Rule Tor WW Is: SOLVE -> PLAN + [DEBUG]. 

Rule for WW- 1 Is: PLAW -> IDENTIFY j DEC0HPQ5E | REFORMULATE. 
What now' 
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2b ♦ > DECOMPOSE. 

In this *ay, SPADE will try tD enrage users to articulate thair d„i(,n 
decisions in top-do™ order. At the « tiw. the system should offer the user 
the rr ecd ™ to escape f rom thls strict dlielpll „ lf fln alt „ Mtlv , „j ntlo|| 
order S e*„s preferable. Ker fl the user interrupts the top-*™ pro.pting. 
suspending pni subgoal to pur sua another,' 

«a. Do you wish to include the optional constituent cleanup r 

6b. > LATER 

7a. Your pending goals ar» POLE, ... and WELL. Uhat now? 
7b. >PQLE 

The imputation of SPADE involves signing an interprets procedure 

to aach orarunitloal operator, to perfor* bookkseplna of tha user's goals. 

Ai a simple uupli of the experiaental utility of spade the 
relationship betw een level of expertise md >plllle , tlon Qf top . dwni plannintf cfln 
be ascertained fro* the frequency of using the LATER capability. Bore subtle 
experiments alen fl these lines .ill ex 4n ine the use of LATER in various planning, 
contexts. 



i^JhOAlfi_Debi, aa ip £r AKj-itjnt: SPADE keeps * thorough record of the 
user's planning decisis, called the j,J« rfe ri, ff£i o fl , fleC(luse D , thU ^ ^ 

possible to design a debugging assist (RAID, for the SPAtfF, environment which 
embodies what ,, believe to be a fairly daep notion of debugging a. the user is 
prompts through the decision tr8e presented hy tha planning ^^ ^ 

choices which light Uad to aynfetic, semantic, or prag«tic bugs can be 

interna, ly f Iii0ged by thfi „, t _. (> , ubsgqusnt ^^ ^^ ^ ^ 

-tart the user te the reliant frU g warni „ fli , tnahEhy aidlng ^ dlagnosi5 

moreover, the SPADE monitor can then be revoked to guide repair of the o ug by 
re SUB , itt8 pi sn „ ing lB th9 Contm nf tf]( ^^ ^^ (flg(jr& g) 
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Fjflure_ 9 . RAID Advice for Syntactically Incaaplatg. pianning_ Bugi 



la. Which subgoal woulrl you like tn pursue? 
lb. >POLE 

2a. Rule for POLE-1 i&j PLMl -> IDENTIFY | DECOMPOSE | REFORMULATE. 

fc"hat now? 
Zb. >TDEMTIFY 

3a, Rule Tor P0LF--2 Is: IDENTIFY -> PRIMITIVE F DEFINED. 

Whj.iL- now? 
$b, >LAT£R. 

The £dT£/? command enwsri further processing aj this suhgoal to bo postponed. 
RAID, the debugging component , creates a caveat each time a LATER command occurs. 
The CQ-VMl records the fact that thU part of the p {an (j sjfirtacticulltt 
incomplete ot this point, 

4a. POLE-2 postponed. Tour pending fluai list contains the regain in y subgoal 

VEH, Which goal would like to pursue? 
flb* >¥£LL 



Sa T We have new completed the WELL sub goal. What nnw? 
5b, >ftUN HISHTNCWELL 

The caveat recorded earlier is a "dentina," triggered by preKaturc execution of the 
procedure being designed. If this occurs the /unction 0/ tfte caveat is to 
remind the user of the sti n lee tic incorrectness of the program, 

6a. Running UISHINGVELL at this tjpie results in the bug manifestation: 
UNDEFINED PflOCFpLRE- POLE. 
This is hQCiiusE WISHEKfiUELL is syntactically incomplete' it contains 
the pending suhgnal POLE-3, The recommended repair technique is to 
complete the solution of the aubgoal PQLE-Z. Would! you like to wo^k on 
POLE-?,? 

6b. >Ycs. 

,7a. You were solving POLE via an IDENTIFICATION plan. You postponed the 
decision (POLE-2} as to which answer library to use. 
The rule f&r PQLE-Z is; IDENTIFY -> PRIMITIVE ] DEFINED, 
What now? 
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4.3. SHERLOCK -- A Computerized Tutor Computational theories of problem 
solving have Important rami fi cat tons for education. Such theories can servo as 
the normative Justification For a given curriculum, reveal critical knowledge for 
the student excluded from Che traditional syllabus, provide a basis For 
qualitative -- not merely quantitative -- evaljation H and he embodied in 
intelligent tutoring programs to serve as personal learning environments for the 
student. This position is exemplified by SHERLOCK [Goldstein & hUller 1976a]. 
SHERLOCK is- an hypothetical computerized tutor which represents a long tarn 
research direction rather than a detailed program design. SHERLOCK embodies our 
vision of Flexible, sensitive uses of computers to teach problem solving and 
enhance education. The other programs we have designed r each sign if leant 
undertakings in their own right, can also he thought of as necessary components 
for SHERLOCK, 

SHERLOCK'S goal is to imboe a nwrkim krwattdgi: or the SPARE theory in 
novice programners. This daft.? net necessarily meao that fifth graders must use 
terminology such as co-itte^t /ree nr<rmmrr. It dows mean that they should 
experience* actively menlBU late H and explicitly discuss problem solving 
situations which nlyhlighE the planning «nd debugging concepts which the theory 
attempts to formalize. Let us illustrate whet this night mean via a brief 
dialogue , 

SHERLOCK: Hello Debbie. 

What problem are you karlting on today? 

Debbie: >| em going to draw a wlshingwell, 

initially in a less intrusive, batrkmard (ooAirfr mode, SHERLOCK night 
remain silent as Debbie typed in her code for a wishiegw&ll. Unlike the highly 
structured SPADE, SHERLOCK will not take an extremely active role in prompting 
the Student. (Ue plan to experiment with the relative virtues or these two 
tutorial styles.) However, SHERLOCK might intervene when difficulties war*. 
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Debbie; 



> for ward ]flO 
>rigut 90 
> forward 500 

>Oh no! Erase thnc last forward, 



SHERLOCK; 



Ok. 'Forward SOD" has been erased. 
Do you wish to group the other 
lines together into a procedure? 



Hera, a simple rula of programing style -- the use of sub procedures 
enphaslfed, 



is being 



Jlany couple* issues urn raised by the design of such tutoring program. 
Our purpose in introducing SHERLOCK has merely been to illustrate one potential 
pedagogical application for a computational theory of design, The next section 
turns our attention to the synthetic aspect! of our enterprise, by introducing an 
AI problan solver called PATH. 

g. Synthetic Aspects 



While context frae grammars can represent a useful abstraction of 
planning decisions, they have limitations which prevent them fron providing a 
complete theory of design. To address this, wa have designed PATH, art AI problem 
Solver, PATW, like SPADE, starts from nur taxonomy Of plans. But PATM taltes the 
linguistic analogy one step further. An augmented transition network [AFN, 
[Woods 1970]) is used, to capture not only the syntax or plans, but also their 
semantics and pragmatics r 
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i I- P ATN -*■ An Augmented Trans itlon_N et worfc for Planning: Figure 10 
provides a global view of PATH [Goldstein A Miller ]S7fih]. Here the decision to 

pursue an idontifleation plan versus * decomposition, for example, Is modeled by 
an ere transition. Semantics are added, by defining a let oF registers to record 
the problem, deitr (ptiflu, proposed saiyUp*, planning edifice, and debugging 
efli?ecitJr Pragmatic information is also Incorporated, by associating conditions 
and acrlons with various arcs- For instance, an identification plan cannot 
proceed ji' the problem description cannot be found in the answer library. PATN 
elaborates our notion Of a plan, by associating Semantic variables {snapshots of 
the ATM registers} with each node of Hie plan derivation, One application of 
PATN is as a nodule of SPADE Y providing an enhanced sot of f natures to aid the 
user in communicating p'ans. Our implementation plan for PATN ts to. provide 
SPADE with a node of operation in which a progressively larger percentage of 
planning choices are made without consulting the user. 

5.2, DAPR — A >1ode l of Debuggings PATH can make ■istafcts. That is t 
PATH wi?. ] somttiaes introduce what wo term rational ONgj into its plans, due to 
■taking arc transitions wiUi imperTect knowledge or subtleties and interactions In 
the tish domain naturally, PATN will come equipped with a corresponding 
iJebi^ij.riri-7 nndulo {DAPR), Whereas MID is designed to assist human prngramners In 
finding a variety of bugs (primarily hy plan diagnosis}, DAPR Is specifically 
designed u, rti«ly£e PATH'S bugs, employing three diagnostic techniques: model, 
process^ and plan diagnosis. Model diagnosis is the basic technique, it anou-nts 
to conip-arlng the effects vt executing a plan to a formal description oT its 
goals, to determine if, and in what fashion, the plan has failed. Another DAPR 
technique, based on Sussman's HACKFR [1*75], is examining the state of the 
process at thv tli-ie n^ *he error manifestation. Plan diagnosis, is a DAPR firs.t. 
It IS ttccninpIishecJ >.-' eXaitining the eniteets variable associated with V trio-US 
nodes of PATN's plan derivation. 

DAPR could bfc used to provide additional guidance to RAID. This 
possibility illustrates the synergism possible when normative, synthetic, and 
analytic facets of a cognitive theory are studied in an integrated fashion. In 
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the ne*t section we pursue the analytic facet of our investigation of the design 
process, introducing PA2ATN, in automatic protocol analyzer. 

6. Analytic . Aspect s 

As snmn as one has an henrist lcdllY adequate theory of design, it Is 
natural to ask, H Can thE thEory provide an account of how people salvo, 
problems?". The traditional (i.ff,, [Newell 1966}) experimental technique for 

answering this question is the analysis of protocols collected during problem 
solving sessions. Uh 1 1'h this generally Implies transcriptions of think fltoUd 
verbalizations, a useful sinpl if ication is to examins the sequence or keystrokes 
from a console session iti a computerized data gatherlna contest . 

5.1. Protocol Analysis as Pa rsing The analysis task In such a setting 
is to interpret user typ#-ins during a console session in terms of a theoretical 
model of the planniiui and debugging processes. Our linguistic analogy is helpful 
hare, wherein wft define protocol analysis as the construction Of an hierarchical 
description of the protocol in terns or our problem solving grammar. [Wilier * 
Goldstein iiJ7eb] provides a detailed exanple of such analysis being performed by 
hand. In that paper h he examine a high school student's Logo protocol in detail, 
summarizing the sorts of Insights obtained when protocol analysis is viewed at 
pursing ih this sense. 

Just as a context free Grammar is Incomplete as a theory of planning, 
likewise a parse is only a partial analysis of a protocol. The theory or 
annotation developed in the PATH work leads us from describing only the structure 

to mora complete analyses of protocols 1 an interpretation of 4 protocol is the 
selection or a particular patn plan derivation. Hence analysis should consist or 
linking protocol evuuts into the data structures of PATN and of advanced ve r s i n n <. 
of SPADE. 
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6,Z, PAZATN -^ ft Par**. w Elementary Programing PratnrnT^ rianual 
protocol analysis is unaceeptably tedious and Informal. Hence [Killer A 
Goldstein I97fid] introduces the design for an automatic protocol parser, PAZATN. 
FAZAT* will analyze protocols by matching them against possible solutions which 
PATAT generates, PAZATN Hill operat, by musing PATN to deviate rrcu it, 
preferred approach in response to bottom-up evidence f figure 11} , Also, "buggy* 
version* ef synthetic plans ( including irrctioncl bugs *hith would not be 
introduced by PAIN) can probably be recognised. 

PAZATN's desisn is a generalization and elaboration of the ccrottttn* 
aearch plan~f indins, procedura described for Hycroft [Goldstein 1375], Looking to 
computational linguistics fer guidance, PAZATN Has been extended to take 
advantage of powerful search strategies developed in research on speech 
understanding [lesser et al. 1575; Paxton i Robinson 1*75], as hell is 
sophisticated data structures developed in work on syntactic analysts [Key 1973 j 
Kaplan. 1973], 

PAZATH Hill be constructed by supplementing PATH with e number of 
additional modules and data structures. Figure 12 provides a -ore detailed blocs 
diagram. One data structure, the PUMCHAftT, keeps track or the set of plausible 
subgcal* wMch hive been proposed by FAT* Aether, the DATACHART, records the 
state D f partially completed interpretations A preprocessor module will be used 
to suppress uninteresting syntactic details and to perform preliminary 
segmentation. The preprocessor employs an event classifier to determine the 
syntactic class of each event. Corresponding to each syntactic category, PA2ATM 
will be supplied with an event specialist «hich embodies the requisite domain 
knowledge for assisting an event interpreter in associating an event or that type 
«ith some synthetic subgual Since a purely top down or bottom up Strategy would 
be too inefficient, a scheduler nodule is necessary to direct the anaiywr 
through a *«£ /irat CO fob if ire Mflrcfl. 

Just as PATN will be implemented by amending SPADE to the extreme or 
never revesting guidance fro- tie user. PAZATW will be implemented by extending 
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5FADE to the opposite extreoe. That Is, in the pure PAZATN situation, the systen 
must infer the user's plan entirely frnm code level events, with no explicit 
articulation or tn« intermediate levels or the plan. PAZATM will be useful in 
increasing SPADE "S flexibility in handling ambiguous events, and in alleviating 
what might seem to some users to be an excessive allocation or time and effort to 
the planning phase. moreover, systematic experipen tation with PAZATN will 
provide evidence regarding whether PATH can servo as the basis ror modal* of 
human problem solving. 

7, Conclusions 

Wa have studied problem solving Tar tasks which may be characterized as 
the design of artifacts: the outlines for SPADE, a computational theory of 
design, have been presented. The normative, synthetic, and analytic aspects of 
its role in the overall research enterprise have been illustrated by introducing 
several experimental applications prolans. The exploitation of concepts and 
algorithms from computational linguistics is a recurring themes grammars* ATN's + 
derivation trees, search strategies from speech understanding, chart-based 
parsers. We believe that our unified approach to the objectives of several 
fields, utilising methods Trom each, represents a new paradigfl which, can provide 
benefits to all of them. 

rtuch remains to be done. While far greater detail is available in our 
other papers, not every detail of the 3f*AD£ theory has been specified- Although 
almost all or the programs have been designed, even hand-simulated, none have 
bpnn tQplemented. Neither the utility, the validity, nor the generality of th« 
theory has been demonstrated. If the individual research projects succeed, a row 
Clarity will have been brought to the Study Of problem solvinn. If, perchance, 
they should fell, then the reasons for the failures should nevertheless provide 
useTul Insights, 
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